Regularizing deep networks with prior knowledge: A constraint-based approach
نویسندگان
چکیده
منابع مشابه
Rule mining with prior knowledge - a belief networks approach
Some existing data mining methods, such as classification trees, neural networks and association rules, have the drawbacks that the user’s prior knowledge cannot be easily specified and incorporated into the knowledge discovery process, and the rules mined from databases lack quantitative analyses. In this paper, we propose a belief networks method for rule mining, which takes the advantage of ...
متن کاملA constraint-based approach to incorporate prior knowledge in causal models
In this paper we address the problem of incorporating prior knowledge, in the form of causal relations, in causal models. Prior approaches mostly consider knowledge about the presence or absence of edges in the model. We use the formalism of Maximal Ancestral Graphs (MAGs) and adapt cSAT+ to solve this problem, an algorithm for reasoning with datasets defined over different variable sets.
متن کاملRegularizing Deep Neural Networks by Noise: Its Interpretation and Optimization
Overfitting is one of the most critical challenges in deep neural networks, and there are various types of regularization methods to improve generalization performance. Injecting noises to hidden units during training, e.g., dropout, is known as a successful regularizer, but it is still not clear enough why such training techniques work well in practice and how we can maximize their benefit in ...
متن کاملRegularizing Deep Hashing Networks Using GAN Generated Fake Images
Recently, deep-networks-based hashing (deep hashing) has become a leading approach for large-scale image retrieval. It aims to learn a compact bitwise representation for images via deep networks, so that similar images are mapped to nearby hash codes. Since a deep network model usually has a large number of parameters, it may probably be too complicated for the training data we have, leading to...
متن کاملRegularizing deep networks using efficient layerwise adversarial training
Adversarial training has been shown to regularize deep neural networks in addition to increasing their robustness to adversarial examples. However, its impact on very deep state of the art networks has not been fully investigated. In this paper, we present an efficient approach to perform adversarial training by perturbing intermediate layer activations and study the use of such perturbations a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Knowledge-Based Systems
سال: 2021
ISSN: 0950-7051
DOI: 10.1016/j.knosys.2021.106989